Aligning Faithful Interpretations with their Social Attribution

Abstract We find that the requirement of model interpretations to be faithful is vague and incomplete. With interpretation by textual highlights as a case study, we present several failure cases. Borrowing concepts from social science, identify problem misalignment between causal chain decisions (causal attribution) attribution human behavior (social attribution). reformulate faithfulness an accurate causality model, introduce concept aligned faithfulness: chains are with their expected behavior. The two steps together complete process explaining this formalization, characterize various failures misaligned highlight interpretations, propose alternative remedy issues. Finally, implement explanations proposed format using contrastive explanations.